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herein by reference. 

10 

BACKGROUND OF THE INVENTION 

The present invention relates generally to the field of telecommunications 
application platforms or servers and more specifically to providing a gateway access server 
that provides telephony services and information retrieval service over a voice over IP 
1 5 (VOIP) network with out using any hardware cards commonly referred to as TICs 

(Telephony Interface Cards) and which is scalable to handle many users simultaneously. 

Telecommunication application servers that provide telephony services and 
information retrieval service are known, however most of them use traditional PSTN (Public 
Switch Telephony Network) infrastructure to provide such service using various types of 
20 signaling mechanisms like Tl, El, SS7, etc. 

Most recently there are some systems that provide similar service over the 
voice over IP (VOIP) networks. All of these systems use telephony interface cards to connect 
to either the PSTN or the VOIP network. An overview of a typical system is depicted in Fig. 
1. 

25 There are other systems that provide limited functionality like PC to PC and 

PC to phone communication services using software only model however these systems are 
not scalable because they perform transcode operation using the software model. 

Transcoding is the process of converting one voice data format to another. All 
of the existing systems interact with the VOIP network using network supported CODEC 

30 format like G723.1 or G729 etc., however they a perform transcode operation on the data to 
convert it into either standarcTPCM, Mu-LAW and/or A-LAW before the application can 
handle the data. The cost of a phone call on a PSTN costs about 7 to 10 cents a minute while 
the cost of a phone call on a VoIP network has been reduced to about 1 cent a minute. 
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Transcoding is computationally intensive operation required to be done by a special hardware 
device called a TIC (Telephony Interface Cards) for scalability reasons. When transcoding is 
done in software the system is not scalable because the transcoding operation ties up large 
amounts of resources. There are also systems that perform transcoding in a batch mode in a 
5 non real-time bases, i.e. offline batch processing. However this approach does not provide 
instant/real-time access to information until the transcode operation is complete. In some of 
the systems the message store stores multiple formats of the same data, one format for the 
VOIP/PSTN network and another format for access through the web. However such systems 
are either storage intensive, CPU intensive, or non-real-real-time oriented and cannot scale to 
1 0 a very large user base nor be used to provide synchronized data between the web and the 
telephone network. 

Web portals, such as Yahoo, the assignee of the present application, receive 
millions of visits per day. Accordingly standard VoIP interfacing techniques such a TICs or 
software transcoding add cost and complexity to implementing telephony access to services 

1 5 normally provided by a web browser. As is well-known, revenue generation in e-commerce 
is often not linked to the services provided so the cost of providing these services must be 
carefully controlled. On the other hand the mobility and availability of telephones to 
potential visitees provides a tremendous business opportunity. 

Because of the above constraints, a telecommunications application server that 

20 can provide functionality's like unified messaging, voice portal access to information and 
communication services must use specialized hardware such as TICs. Using specialized 
hardware limits the server to be developed only on a platform running operating system 
supported by the hardware vendor. Building such an scalable application server on a platform 
running a operating system like Free BSD UNIX that is not supported by the hardware 

25 vendor is not possible. Further, the cost of using TICs makes the cost of implementing such a 
telecommunications application server prohibitive. 

From the above, it is apparent the improved systems for providing telephone 
access to various services now provided by the internet are needed. 

30 SUMMARY OF THE INVENTION 

According to one aspect of the invention, an improved telecommunication 
application server handles a wide variety of call control, messaging and information retrieval 
functionality using a software only model In one embodiment, a process is started which in 
turn has several threads, one for each telephony channel handled by the process. The number 
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of threads per process is configurable, it is generally set to 24 or 30 similar to the number of 
channels handled by a traditional Tl/El interface. Multiple processes can run on a single 
system. All the processes and threads share a large amount of shared memory that contains all 
of the system phrases/prompts, this minimizes the amount of delay in playing phrases. 
5 According to another aspect of the invention, if the total number of channels 

i.e. simultaneous telephony subscribers becomes too great for one gateway access server to . 
handle, the system is easily scaled by adding additional gateway access servers. Each 
telecommunication access server maintains its own copy of the phrases/prompt data in its 
shared memory. There is no need to have any communication between telecommunication 
10 access servers. 

According to another aspect of the invention, data received in native VoIP 
format is processed without transcoding so that no hardware Telephone Interface Card (TIC) 
of software transcoding is required. 

According to another aspect of the invention, data received from the VoIP 
15 network or to be transmitted on the VoIP network is stored in native VoIP format in the 
shared memory thereby increasing storage efficiency. 

According to another aspect of the invention, text resources, such as email, 
may be accessed by telephone utilizing a text-to-speech converter (TTS) which outputs voice 
data in non-native VoIP format. A voice coder is utilized to transcode the output of the TTS 
20 to native VoIP format. 

A further understanding of the nature and advantages of the invention herein 
may be realized by reference to the remaining portions of the specification and the attached 
drawings. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a typical prior art VoIP telecommunication 

system; 

Fig. 2 is a block diagram of a preferred embodiment of the invention; 

Fig. 3 is a block diagram depicting the architecture of a preferred embodiment 
30 of the voice services platform; 

Fig. 4 is a block diagram depicting the architecture of a preferred embodiment 
of the gateway access server; 

Fig. 5 is a block diagram depicting the architecture of a preferred embodiment 
of the VOIP API; 
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Fig. 6 is a block diagram depicting the architecture of a preferred embodiment 
of the channel thread; 

Fig. 7 is a flowchart depicting steps performed to service a request for a 

service; 

5 Fig. 8 is a screen shot of a web page listing voicemails messages for a service 

requestor; and 

Fig. 9 is a screen shot of a web page implementing an applet for listening to 
voicemail messages transmitted over the internet in native VoIP format. 

1 0 DESCRIPTION OF THE SPECIFIC EMBODIMENTS 

A preferred embodiment of the invention will now be described with reference 
to the My Yahoo telephone interface being developed and implemented by the assignee of the 
present application. However, the invention is not limited to any particular implementation 
but has broad applicability for VOIP applications and provides many benefits which wll be 

15 apparent from the following description. Users will access My Yahoo by dialing 1-800- 

My Yahoo from any telephone. My Yahoo will provide a universal message service including 
voice (such as phonemail), fax, and text (such as email). The users phone will be connected 
to My Yahoo servers via the internet and will use internet telephony, also known as Voice 
over IP (VoIP) protocols. The user requests information or services using the telephone and 

20 receives voice response generated by the My Yahoo servers. 

Fig. 2 depicts the connections of an embodiment of the present invention to 
PSTN. Gateway connect the PSTN to the VoIP network and encode voice data in G.723.1 
format which is encapsulated in IP packets. A network interface card (NIC) connects the 
server to the VoIP network. Software on the server processes data in the G.723. 1 native 

25 VoIP format so that the need for TICs or software transcoders is eliminated. 

Figure 3 shows a distributed client server system which is used to provide 
telecommunication application services to callers/subscribers over a managed VOIP network. 
A preferred embodiment includes the following systems. 

GAS (Gateway Access Server) : GAS is the primary server that is connected 

30 to the VOIP network over a managed IP network link. GAS implements the VOIP protocol 
and exposes it to the application call flow using an API called VOIP_APL The GAS module 
is further described in the later part of this section. The architecture of the GAS is depicted in 
Fig. 4. 
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The Call Flow interface provides a consisten application programming 
interface (API) that allows internal applications, such as email readers, voice mail 
applications, stock quote applications, etc., to obtain the services of the GAS and interface 
with the managed VOIP network. 
5 Further, a telephone applications API provides a consistent interface for third 

parties to write applications to obtain the services provided by the GAS thus additionally 
enhancing the scalability of the system. 

MAS (Message Access Server) : MAS is responsible for the message store. 
Unlike traditional voice mail/application servers where the call flow application logic and 
10 message store are on a monolithic system. In this embodiment the message store is separated 
from the GAS which runs the call flow and application logic. This enables the provision a 
very large-scale system where a GAS can access any of the message stores based on the user 
it is currently serving. The system is scalable so that multiple MASs may be provided. 

TTS (Text To Speech Server) : The TTS server is responsible for converting 
1 5 text into speech that can be played to the user. Some of the applications include providing the 
user with the capability of listening to email and other text based content from the phone. 

ASR (Automatic Speech Recognition) : The ASR server is responsible for 
recognition of voice data sent to it and translating it to text that is sent back to the requester. 

VC (Voice Converter) : VC is a server that can convert one format of the 
20 voice into another. 

WAS (Web Access Server) : WAS enables the subscriber to retrieve their 
voice and fax messages from the web. It also provides registration service and billing 
information access service. 

AAS (Add Access Server) : AAS enables the call flow to have access to a set 
25 of advertisements so that it can target appropriate add for the subscriber. 

NAS (News Access Server) : NAS stores the latest news items in a manner 
that can be easily accessed and played to the caller. 

CAS (Content Access Server) : CAS provides access to content like stock 
quotes, weather information, sports information and customized content for the user based on 
30 My.Yahoo.com settings. 

YIMail (Yahoo Mail Servers) : The GAS talks to the yahoo mail servers to 
enable subscribers to listen to their email using the phone. 

AB (Address Book Server) : The GAS talks to the yahoo address book server 
so that subscribers of this service can send messages to anyone in their address book. 
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UDB (User Data Base Server) : UDB stores the mapping between the user and 
the MAS that was allocated for that user. 

The art of sending telecommunication data over managed VOEP networks is 
well known and will not be addressed in detail here. Essentially the user of this service will 
5 make a call to 1-800-My Yahoo. The network provider i.e. carrier will carry this call over 
their managed VOIP network and will terminate the call into one of the gateway access 
servers (GAS) that is available to handle the call. The GAS receives the OLI (Originating 
Line ID) i.e. caller ID information and can decide if it wants to answer the call or reject the 
call. Using the OLI information avoids any abuse of this service. 
1 0 The GAS performs standard TCP/IP such as receiving packets, extracting data 

from packets received, and encapsulating data into packets to be sent. 

When the user of this service dials the access number (1-800-My Yahoo), the 
signaling thread in the VOIP API as shown in figure 5 will receive a TCP/IP signal called 
"call indicator" indicating that there is an incoming call. The VOIP API will notify the 
15 application call flow through Yahoo! Telephony API as outlined in figure 4. At this point the 
application can either accept a call or reject a call. Once the application accepts the call the 
signaling thread will find a channel thread that is ready to handle the 10 and will setup a UDP 
connection between the channel 10 thread/process and the VOIP network. All voice, fax data 
sent from and to the user will go through this UDP connection. 
20 Fig. 6 is a more detailed depiction of the channel thread architecture. The 

signal processing thread is called to handle channel signaling. This thread would detect and 
process DTMF tones and CLI information. The 10 thread processes packets carrying voice 
data in the native VoIP format. 

An overview of the interaction between the telecommunication access server 
25 and user is depicted in the flow chart of Fig. 7. 

Subsequent to setting up the UDP connection the thread must determine the 
type of service requested by the user. Two different techniques will be implemented. The 
first responds to a series of DTMF tones to identify a requested service. For example, the 
tones generated by pressing "E" (3) followed by "M" (6) could be interpreted to be a request 
30 for email services. It is also possible for the application to play a prompt 'Tress 2 to listen to 
your email" and the subscriber will indicate its interest by pressing DTMF key "2". 

Alternatively, automatic speech recognition services (ASR) can be utilized to 
determine voice commands such as the user saying "EMAIL". In the present embodiment, 
ASR utilizes voice data in PCM format so that a voice coder (VC) is utilized to convert 
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speech commands from VoIP format to PCM format. Since only commands are converted to 
non-native VoIP format in this embodiment the advantage of not decoding all incoming voice 
data is still substantial. 

Subsequent to determining the service requested, appropriate voice response, 
5 stored in shared memory in native VoIP format, are accessed, encapsulated into VoIP 
packets, and transmitted over the VoIP network to the service requestor. 

Some of the technical challenges that have to be solved in designing such a 
system include. 

10 1 . Jitter and prompt continuation control 

2. Bi-directional packet streaming 

Jitter and Prompt Continuation Control : 

One of the problems encountered in designing such systems is the jitter and 

15 prompt continuation control i.e. breakup of speech because of pauses/delays in serving voice 
data to the VOIP network. To address this problem each of the channel threads in the 
gateway access server (GAS) a dedicated 10 thread maintains a voice continuity buffer that 
holds voice data for a smooth delivery of concatenated phrases. A concatenated phrase is a 
voice prompt that is built from two or more individual phrases. For example "You have 10 

20 messages" is built from three phrases "You have" + "10" + "Messages". When this phrase is 
played there has to be a smooth and continuity between each of the individual phrases. 
Having a configurable size look a head continuity buffer in the 10 thread provides this 
functionality. 

When the application requests the 10 thread to play the phrase "You Have", 
25 the IO thread plays the phrase till ninety (90 ms) milliseconds before the end. It will then 
return back to the application and continue to play the remaining 90 ms in the background 
while the application requests the next play phrase operation for "10". This process repeats 
till the entire phrase has been played. Further to minimize the delay in accessing the voice 
data for the phrases, all the phrases are stored in shared memory. In once embodiment a 100 
30 Meg of shared memory was used to hold half .a million phrases. 

Bi-Directional Packet Streaming : 

Each of the channels can send as well as receive data from the VOIP network 
at any given time because telecommunication applications/networks are bi-directional 
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applications. To support this functionality, each of the channels has a dedicated thread, called 
the 10 thread, that manages all the 10. The 10 thread is designed to provide directional 
priorities for the data handling based on the application function that is requested. 

While playing the phrase or a message, the 10 thread gives higher priority to 
5 data transmission compared to data reception. In this mode the 10 thread has to send a voice 
packet every 30 or 60 or 90 milli-seconds. At the same time it has to read the data from the 
network. While playing voice data, the 10 thread will always first transmit a voice packet 
and then block on the select call monitoring for incoming data. If there is any incoming data 
it will read the data and handle it as required. The select time out is set equivalent to the time 
1 0 when the next voice data has to be transmitted. 

While recording a message or while waiting for the data to come in on the 
network the 10 thread gives higher priority to data reception and does not perform any data 
transmit operations. In this mode, the 10 thread blocks in an extended duration time out based 
on the application operation requested and will collect the data as required. For example, if 
1 5 the application requests a message record operation for 30 seconds then it will block on the 
selected system call for that duration and will collect data as it comes in. 

An important aspect of bi-directional packet streaming is that while playing a 
voice prompt priority is always given to the out bound data and the remaining time is used to 
handle the incoming data. While playing a phrase the inbound voice packet must be 
20 processed during the time between two out bound voice packets. 

To address the scalability issues the voice data is handled in the network 
native format, which in this case is G723. 1 . This eliminates any need for hardware or 
software transcoding operations to converting VoIP data into either PCM, Mu-Law and/or A- 
Law. Because there is no transcoding operation any application that has to store the data like 
25 the voice mail messages must store them in the network native format. This functionality is 
provided by the MAS which stores all of the voice data in G723.1 format. 

The economic advantage of processing and storing data in native VoIP data is 
significant because no dedicated hardware TICs are required for scalability. For example, a 
- 96 port TIC presently costs about $14,000. If each server (present cost about $3,000) can 
30 host two TICs then the cost of a 192 port setup is $31,000 for a cost per port of $161. 

However, for a completely software-based system, assuming $3,000 per server, the cost of a 
216 port setup is $12,000 for a cost per port of $55.55. Further, by using VoIP instead of 
PSTN the cost per minute of phone call is reduced from 7 to 10 cents a minute to about 1 cent 
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per minute for a 90% savings. If a projected 500,000 minutes of phone calls are received a 

day then the savings are $45,000 per day. 

Traditionally the PCM format is used for playing and storing of messages or 

voice data. In the preferred embodiment, messages and data are stored in VoIP format, e.g. 
5 G.723 . 1 , which is a factor of 1 0 smaller than the traditional PCM format for a reduction in 

storage cost of 90%, 

The GAS has several tens to hundred of thousands of phrases/prompts that can 

be played to the user of this service. These prompts are stored in a large shared memory in 

the network native format i.e. G723.1. All of the processes and threads that run on the GAS 
1 0 will attach to the shared memory to use the voice prompts/phrases. This method of storing the 

phrases/prompts in the shared memory enables the application to use the phrases/prompts 

with out having any additional time requirements for accessing them. The shared memory can 

hold several hundred thousands of phrases like the system greetings, company names, city 

names, letters, numbers, etc. In one embodiment a half a million phrases are stored in 100 
1 5 meg of memory and the number of phrases stored in memory called in-RAM-phrases can 

easily be increased by allocation more memory. 

This architecture eliminates any need for the GAS to perform transcoding 

operation because the GAS handles all data operations in the network native CODEC format. 

The GAS uses MAS to store the messages in the network native format. 
20 For users accessing the application using the web, the WAS will install a 

signed plug-in Java applet that can play voice messages in the network native format i.e. 

G723.1. This makes the message store have a single message format that is small (about 6.4 

Kbps encoded data compared to 64 Kbps or 128 Kbps PCM encoding). The very small 

encoding size not only helps the message store to be effective it also enables the GAS to 
25 handle several number of simultaneous calls coming in from the VOIP network. In one of the 

embodiment was tested with 96 simultaneous calls being handled by the system purely in 

software with vast amount of CPU cycles still left for idling indicating that even a higher 

number of simultaneous calls can be handled. 

A browser interface is depicted in Figs. 8 and 9. In Fig. 8, the browser 
30 displays a web page listing the voice mail messages received by the service requestor. In Fig. 

9, the signed plug-in Java applet displays controls for listening the voicemail messages stored 

in native VoIP format. 

The architecture uses some of the products provided by other vendors like the 

Text To -Speech (ITS) and, Automatic Speech Recognition (ASR) that operate using standard 
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PCM/A-Law/Mu-Law voice formats. Because of this, a voice coder (VC) is used to perform 
CODEC conversion between voice formats. The VC uses special boards that perform voice 
format conversion for TTS and ASR resources. Using the VC to transcode for limited 
purposes is much more efficient than transcoding all VoIP data being processed by the GAS. 
5 Analysis has determined that only a small fraction of incoming calls, e.g., about 20%, will 
require TTS services so that it is much more efficient to transcode only the output of TTS 
into in VoIP format rather than convert all incoming VoIP to standard PCM/A-Law/Mu-Law 
voice formats. Therefore, 80% of the conversion between formats is avoided by processing 
voice data in native VoIP format. 

10 , The architecture also enables intelligent information access from the 

telephone. This intelligence is provided by extracting the integration information from the 
VOIP signaling protocol that contains the CLI (Calling line ID), i.e. caller ID information, 
and mapping it to V & H (vertical and horizontal) coordinates and/or city name and/or zip 
code. This allows the user to be located on a map. The map provides city boundaries. This 

1 5 information is used in selecting default content selection for the user calling for this service. 
For example a user calling 1-800-My Yahoo from (408) 328-7829 into the system. The 
system extracts the caller ID information from the VOIP network and this is used to map the 
user location. Based on the location of the user information like weather, sports etc are 
customized. The user can over ride these customizations by creating a my.yahoo.com 

20 account, in which case the defaults will be replaced with the my.yahoo.com 

customizations/defaults. In case where the information requested for the exact location of the 
user is not available, then the search will be expanded to provide nearest location for which 
the requested information is accessed. 

Other intelligent defaults can be provided in other contexts. For example if the 

25 user wants to go to a nearest Italian restaurant. A list of closest choices could be created and 
made available to the user. When a user selects a particular choice would we use the location 
of the user is used to provide driving directions to the restaurant of other places of interest. 
This information can also be used to provide local time zones and time of day information. 

As outlined in Figure - 4, the system provides a means for any external 

30 appellations to be integrated into it by using the YTAP (Y ahoo! Telephony Application 
Protocol) protocol. A particular embodiment enables external appellations to be accessed 
using YTAP by providing a VXML (Voice XML) interface cover over YTAP protocol. This 
can be used to integrate with external web servers and applications. 
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The gateway access server (GAS) is capable of providing different classes of 
service based on the user identification. The mechanism of providing different class of 
service capabilities enable the system to group users based on service requirements like paid 
users could get extended message save duration as well as the number of messages per user 
5 groups can be based on the class to which they belong. 

The invention has now been described with reference to the preferred 
embodiment. Alternatives and substitutions will now be apparent to persons of skill in the 
art. For example, the embodiments utilizing the UNIX operating system are described, 
however other operating system including MS NT and Windows can also be used. The terms 
1 0 threads and processes are utilized to have the widest meaning understood by persons of skill 
in the art. Different VoIP encoding schemes such as G.726 or CELP encoding. 

The existing yahoo voice services platform is located at yahoo! premises or at 
one of its co-location felicities. The Telecommunication application server called GAS is 
currently connected to the VOIP network. The connection between the VOIP network and the 
15 GAS will carry all of the voice data from the subscriber to the application server. 

Further, in the embodiments describe above, when the subscriber calls Yahoo 
voice services, the VOIP network will send a notification indication to the GAS, indicating 
that there is a incoming call. At this point the GAS will direct the network to answer the call. 
20 Once the network answers the call it will send call complete signal to the GAS. At this point 
the GAS will send voice prompts like "Well Come to Yahoo" etc. Once the call has been 
established, actual voice data will be sent to the VOIP network from the GAS and similarly 
any time the subscriber talks this data will be sent from the network to the GAS. 

Alternatively, the integrated VOIP system can work with the VOIP network 
25 provider to encapsulate the entire Yahoo voice services architecture into the VOIP network 
and have a control protocol that will control and manage the data using YTAP (Yahoo 
Telephony Application Protocol). 

Accordingly, it is not intended to limit the invention except as provided by the 
appended claims. 
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